It comes after Lord Patten announced that he would be retiring after more than 20 years in the historic position